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squares  estimation  algorithm.  The  least  squares  algorithm,  which  is  a  special  case  of  the  Kalman  estimation 
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v'  algorithm)  can  be  made  to  grow  only  linearly  with  the  number  of  filter  coefficients.  Furthermore,  these 
computationally  simpler  least  squares  algorithms  may  be  implemented  either  in  tapped  delay  line  or 
lattice  form.  The  application  of  the  Upped  delay  line  form,  i.e.,  the  fast  Kalman  algorithm,  to  channel 
equalization  has  been  considered  recently  by  Falconer  and  Ljung.  In  this  paper,  it  is  shown  how  the 
least  squares  lattice  algorithms  originally  introduced  by  Morf  and  Lee  can  be  adapted  to  the  equalizer 
adjustment  algorithm.  The  extremely  rapid  start  up  convergence  properties  of  the  least  squares  lattice 
equalizer  are  confirmed  by  computer  simulation. 


SECTION  1.  INTRODUCTION 


Traditionally,  equalization  of  a  baseband  pulse  amplitude  modulated  (PAM)  system 
has  been  accomplished  with  a  tapped  delay  line  (TDL)  filter.*  However,  the  application  of 
lattice  structures  to  channel  equalization  was  presented  in  a  recent  report  by  Satorius  and 
Alexander.  ^  Lattice  structures  offer  a  number  of  potential  advantages  over  TDL  filters. 

First,  an  N-stage  lattice  filter  automatically  generates  all  of  the  outputs  which  could  be 
generated  by  N  different  TDL  filters  with  lengths  ranging  from  1  to  N  filter  taps.  This 
property  of  lattice  structures  allows  the  dynamic  assignment  of  the  particular  length  of  the 
lattice  equalizer  that  proves  most  effective  at  any  instant  of  equalization.  A  second  advan¬ 
tage  is  that  longer  lattice  filters  may  be  built  up  from  shorter  ones  simply  by  adding  on  more 
lattice  stages.  This  property  should  prove  useful  in  designing  large  scale  systems  which 
employ  lattice  equalizers.  Finally,  an  important  property  of  lattice  structures  in  general  is 
their  high  insensitivity  to  round-off  noised  The  implications  of  this  property  with  regard  to 
adaptive  lattice  equalization  will  not  be  examined  in  this  paper  but  that  is  an  important  area 
for  future  investigation. 

This  report  is  concerned  primarily  with  the  adaptation  algorithm  used  to  update  the 
filter  coefficients  in  the  lattice  equalizer.  In  particular  it  will  demonstrate  how  the  recently 
developed  least  squares  lattice  estimation  algorithms  of  Morf,  Lee  and  others^  can  be 
used  to  provide  the  extremely  rapid  start  up  performance  of  the  lattice  equalizer.  This 
rapid  initial  convergence  is  characteristic  of  least  squares  algorithms  as  observed  in  References 
8,  9  and  10.  These  references  note,  by  contrast,  gradient  estimation  algorithms  tend  to  con¬ 
verge  much  more  slowly  during  the  initial  training  portion  of  equalization.  This  slower  con¬ 
vergence  behavior  is  also  characteristic  of  the  gradient  lattice  algorithms  (which  were  ex¬ 
amined  in  Reference  2)  as  compared  with  the  least  squares  lattice  algorithms.  Comparisons 
between  gradient  lattice  and  least  squares  lattice  equalizers  will  be  presented  in  this  paper. 
First  we  will  briefly  review  the  general  least  squares  problem  from  which  the  least  squares 
lattice  equalizer  arises,  then,  in  Section  3,  present  the  least  squares  lattice  equalizer  algorithm 
and,  finally,  in  Section  4,  the  simulation  results. 

SECTION  2.  LEAST  SQUARES  CHANNEL  EQUALIZATION 

As  noted  in  Reference  10,  apparently  the  fastest  converging  equalizer  algorithm 
(which  is  a  special  case  of  the  Kalman  estimation  algorithms**’^ >*®)  arises  in  the  context  of 
the  classical  least  squares  problem:  at  each  sampling  instant,  find  the  set  of  equalizer  tap 
coefficients  that  minimize  the  accumulation  of  the  squared  errors  between  the  filter  output 
and  a  desired  output  up  to  that  time.  In  particular,  suppose  a(0),  a(l), .  . .  a(t)  is  a  training 
sequence  of  data  symbols  which  are  known  by  the  equalizer  adjustment  algorithm.  Further, 
assume  that  the  a(n)  sequence  is  transmitted  over  a  channel,  resulting  in  a  sequence  of 
equalizer  inputs,  x(0),  x(l), . . .,  x(n)and  define  Xj^(n)  to  be  an  (N+l)  -  dimensional  vector 
consisting  of  time-delayed  samples  of  x(n),  i.e., 

Xjq(n)  =  (x(n),  x(n-l ),...,  x(n-N)T  (0 

where  superscript  T  denotes  transpose  and  x(n-i)  ==  0  when  i  >  n.  The  least  squares  problem 
is  equivalent  to  finding  the  (N+l)  -  dimensional  vector  of  equalizer  tap  values,  F^(n),  which 
minimizes  the  following  sum  of  squared  errors: 


^  w"-P  |  a(p)  +  F^  (n)  XN(p)  | 2. 

p=0 

The  parameter  w  is  a  real  constant,  0<w<,  and  is  included  in  the  sum  of  squared  errors  to 
allow  the  equalizer  to  track  slow  time  variations  in  the  channel.  Typically,  w  is  close  to  I. 

The  inverse  of  (1-w)  is,  approximately,  the  memory  of  the  equalizer. 

Differentiating  the  above  sum  with  respect  to  the  components  of  Fjq(n)  and  setting 
the  result  to  zero  leads  to  the  following  equation  for  the  Fj^fn)  vector: 

n 

fljq(n)  FN  (n)  =  -  ^  wn"P  a(p)  XN(p)  .  (2) 

p=0 

In  Equation  2,  the  (N+l)  by  (N+l)  matrix,  ft^fn),  is  given  by: 
n 

«N(n)  =  wn'P  XN(p)  Xjj  (p)  .  (3) 

p=0 

The  solutions  of  Equations  2  and  3  provide  the  least  squares  equalizer  tap  vector,  Fj^(n),  at 
the  n**1  data  sample.  Notice  in  the  above  equations  the  limits  on  all  the  summation  signs 
extend  from  p=0  to  p=n.  The  lower  limit,  therefore,  imposes  the  assumption  on  the  data 
that  x(p)  =  0  for  p  =  -1, . . . ,  -N.  These  limits  lead  to  the  so-called  “pre-windowed”  least 
squares  algorithm  (which  will  be  considered  in  this  paper).  If  the  limits  are  p  -  N  and  p  =  n, 
the  un-windowed  or  “covariance”  algorithm  is  obtained.  A  more  complete  discussion  of  the 
different  windowing  methods  may  be  found  in  Reference  5. 

At  this  point,  it  should  be  noted  that  solving  Equations  2  and  3  could  proceed  along 
one  of  two  possible  lines  of  development.  In  the  first  Fjjfn)  obeys  the  following  time  update 
relation  (References  8  and  10): 

FN(n)=  FN(n-l)  -0N(n)$(n),  (4a) 

where 

0N(n)  =  <RN(n)-1  XN  (n)  ,  (4b) 

and 

|(n)  =  a(n)  + FN(n-l)T  XN(n)  .  (4c) 

The  major  computational  burden  in  this  formulation  lies  in  computing  the  (N+l)  -  dimensional 
vector,  0jq(n) ,  at  each  iteration.  Conventional  methods  of  computing  0j^(n)  (i.e.,  the  Godard 
algorithm,  Reference  8)  require  on  the  order  of  operations  (additions  and  multiplications) 
per  update.  However,  by  exploiting  certain  shift  properties  of  Xj^(n),  it  is  possible  to  com¬ 
pute  0jq(n)  at  each  iteration  using  a  number  of  operations  which  depends  only  linearly  on 
N  (i.e.,  the  fast  Kalman  algorithm,  Reference  10).  In  any  case,  this  formulation  (i.e.. 

Equation  4)  of  the  solution  to  Equation  2  leads  to  a  TDL  equalizer  structure  for  which 
-Fjq(n)  represents  the  vector  of  equalizer  taps  and  -F^(n-1  )*  Xj^(n)  represents  the  equal¬ 
izer  output. 
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A  second  solution  to  Equation  2  incorporates  the  lattice  method.  In  this  method, 
certain  properties  of  <Rj^(n)  (these  are  discussed  in  the  Appendix)  are  exploited  to  derive 
order  update  equations  for  the  outputs  ym(n)  =  -Fm(n-lr  Xm(n)  (m  =  0,1, . . .  ,N).  In 
particular,  lattice  recursion  relations  are  derived  which  relate  ym(n)  to  ym_j(n)  as  well  as 
certain  other  auxiliary  variables.  In  this  way  all  of  the  least  squares  outputs,  ym(n) 

(m  =  0, . . . ,  N),  are  automatically  generated.  This  is  in  contrast  to  the  TDL  formulation 
where  only  y^(n)  is  computed  every  iteration.  The  least  squares  lattice  equalizer  algorithm 
is  presented  in  the  next  section. 

SECTION  3.  THE  LEAST  SQUARES 
LATTICE  ALGORITHM 

This  algorithm  is  a  modified  version  of  the  least  squares  algorithm  originally  presented 
in  References  4,  5,  6,  and  7.  The  Appendix  contains  a  derivation  of  the  algorithm.  A  more 
complete  discussion  of  least  squares  lattice  algorithms  in  general  and  their  properties  may  be 
found  in  References  4  through  7  and  1 1  through  13. 

In  the  least  squares  adaptive  lattice  equalizer  (LSALE)  algorithm,  the  following  scalar 
quantities  are  stored  and  updated  every  iteration : 


(1)  Cm(n)’€m(n)’  rm(n)’  em(n)>  em(n>>  km(n)>  ym(n)(m  =  0,1, . . .  ,N). 

(2)  ym(n),  km(n)  (m  =  0,1, . . .  ,N-1). 


To  initialize  the  algorithm,  we  set: 

'm(-l)=W-l)  =  f„H)  =  rm(-l)=0. 

Then,  the  following  computations  are  performed  starting  with  n  =  0: 
eQ(n)  =  rQ(n)  =  x(n) 

e®(n)  =  e*(n)  =  w  e^(n-l )  +  x2(n) 

y_](n)  =  7_)(n)  =  7_j(n-l )  =  0 
e_j(n)  =  a(n)  , 

km(n)  =  w  km(n-l)  +  (l-7m_[(n-l)  )em(n)rm(n-l) 


em+l<n)  =  em<n>- 


km(n-l)  rm(n-l) 


e>-2) 


km(n-l) 

rm+l<n>  =  rm<n-,>  -  — - em(n> 

em(n-D 


(5a) 

(5b) 

(6a) 

(6b) 

(6c) 

(6d) 

(7a) 

(7b) 


(7c) 


(7d) 


€ 


e 

m+1 


(n)  =  e^(n)  - 


km(n> 


em+l(n)  en/n-'' 


Wn)~'>'m_i(n)  + 


km<"> 

em(n) 

j(l-Wn>>rm(n)j2 

em(n> 


km(n-l) 

ym<n> =  ym-i(n> + — - rm<n> 

e,L(n-l) 

m 


(7e) 

(70 

(7g) 


em(n)  =  a(n)-ym(n)  .  (7h) 

The  recursions  in  Equations  7a  through  7f  are  computed  for  m  =  0,1 ... .  ,N-1 .  The  recursions 
in  Equations  7g  and  7h  are  computed  for  m  =  0,1 , .  .  .  ,N.  Finally,  the  coefficients,  km(n),  are 
updated  by  the  recursion: 

km(n)  =  wkm(n-l)  +  (l-7m.|(n))em.,(n)  rm(n)  (8) 

m  =  0, .  .  .  ,N. 

It  should  be  noted  that  6  in  Equation  5a  is  a  small  positive  constant  which  is  used  to  ensure 
nonsingularity  of  the  (Rj^(n)  matrix. 

Equations  5  through  8  represent  the  LSALE  algorithm.  The  scalar,  y^fn),  represents 
the  LSALE  output.  A  schematic  diagram  of  the  lattice  equalizer  is  presented  in  Figures  la 
and  lb.  During  the  initial  phase  of  operation  the  training  sequence,  [a(0),  a(l), . . . ,  a(t)] , 
is  known  to  the  equalizer.  Using  these  data,  the  equalizer  determines  the  channel  character¬ 
istics  and  adapts  to  them.  As  noted  in  Reference  2,  when  actual  data  are  being  transmitted, 
the  LSALE  output,  y^fn),  is  first  thresholded  to  produce  a  reference  sequence, 1i(n).  Then 
^(n)  is  computed  as  in  Equation  7h  with  a(n)  replaced  by'a'(n),  and  km(n)  is  updated  by 
Equation  8.  It  should  be  noted  that  the  above  formulation  of  the  LSALE  is  for  the  scalar 
input  case  (i.e.,  a  linear  equalizer).  Extensions  to  the  vector  input  case,  which  is  required, 
for  instance,  in  the  case  of  decision  feedback  equalization  (Reference  10),  are  straight¬ 
forward  and  are  discussed  further  in  References  4  through  7. 

A  count  of  the  number  of  operations  needed  to  calculate  each  equalizer  output  and 
update  the  LSALE  algorithm,  Equations  5  through  8,  indicates  that  approximately  19L-12 
multiplications  and  1 1L-7  additions  are  required  where  L=N+1  is  the  total  number  of  equal¬ 
izer  taps.  This  counts  divisions  as  multiplications.  It  is  interesting  to  compare  these  figures 
with  those  corresponding  to  the  fast  Kalman'®  as  well  as  the  gradient  lattice  equalizer  algo¬ 
rithm,  referred  to  as  ALCE  in  Reference  2.  The  results  are  summarized  as: 
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J 


Additions 


Algorithm 

Multiplications 

Additions 

LSALE 

19L-12 

11D7 

ALCE 

13L-8 

10D7 

Fast  Kalman 

10L+4 

12L+5 

For  all  of  these  algorithms,  divisions  are  counted  as  multiplications.  As  is  seen,  both  of  the 
lattice  algorithms  have  more  multiplications  than  the  TDL  fast  Kalman  algorithm.  This  is 
due  to  the  power  normalizations  that  are  required  at  each  stage  of  the  lattice.  It  is 
interesting  to  note  that  LSALE  is  more  complex  than  ALCE.  This  increased  complexity  is 
the  price  which  must  be  paid  for  the  faster  convergence  rate  of  the  LSALE  algorithm.  The 
improved  convergence  performance  of  LSALE  over  ALCE  will  be  observed  in  the  next 
section. 


SECTION  4.  SIMULATION  RESULTS 

For  purposes  of  examining  the  convergence  performance  of  LSALE,  we  have  simu¬ 
lated  this  algorithm  for  two  channels  representing  pure,  heavy  amplitude  distortion.  The 
impulse  response  structures  of  these  channels  are  identical  to  those  considered  in  Reference  2. 
The  two  channels  had  eigenvalue  disparity  ratios,  that  is,  ratio  of  largest-to-smallest 
eigenvalues  of  channel  correlation  matrix,  of  1 1  and  21.  In  all  simulations  1 1-tap  equalizers 
were  used,  N  *  10  in  Equations  7  and  8.  The  symbol  sequence  a(n)  was  a  known,  random 
bipolar  training  sequence  (a(n)  =  ±1),  suitably  delayed  so  that  the  minimum  mean  square 
error  TDL  equalizer  taps  would  be  symmetric  about  the  center  of  the  equalizer,  as  discussed 
in  Reference  2.  Also,  a  small  amount  of  uncorrelated  Gaussian  noise,  noise  variance  =  .001 , 
was  added  to  the  output  of  the  channel. 

The  results  of  the  simulations  are  presented  in  Figures  2  and  3,  corresponding  to 
eigenvalue  ratios  of  1 1  and  21,  respectively.  In  these  figures,  6  in  Equation  5a  was  set  equal 
to  .001  and  w  in  Equations  6  through  8  was  set  equal  to  1.  Additional  simulation  revealed 
that  the  start  up  performance  of  LSALE  was  highly  insensitive  to  the  choice  of  6 .  It  was 
found  in  our  simulation  studies  that  the  best  start  up  performance  for  the  LSALE  algorithm 
was  obtained  by  suppressing  the  update  of  thelcm(n)  coefficients  in  Equation  8,  i.e.,  holding 
Tcm(n)  =  0,  m  =  0, . . .  ,N,  until  after  the  main  part  of  the  first  data  pulse  was  received.  The 
number  of  iterations  in  Figures  2  and  3,  however,  is  reckoned  from  the  initial  updating  of 
Equations  6  and  7  and  not  from  the  initial  updating  of  the  Rm(n)  coefficients.  The  improved 
performance  of  LSALE  which  results  from  suppressing  the  km(n)  update  is  analogous  to  the 
improved  start  up  performance  of  the  fast  Kalman  equalizer  which  results  from  initially 
suppressing  the  tap  update,  Fjq(n)  in  Equation  4a,  as  discussed  in  Reference  10. 

For  sake  of  comparison,  Figures  2  and  3  include  corresponding  learning  curves  for 
the  gradient  lattice  algorithm  (ALCE)  described  in  Reference  2,  as  well  as  the  simple 
gradient  TDL  equalizer  algorithm,  also  described  in  Reference  2.  In  fact,  the  parameters  of 
the  ALCE  algorithm  and  the  simple  TDL  gradient  algorithm  are  identical  to  those  parameters 
used  in  Reference  2  which  provided  the  best  start  up  performance,  i.e.,  the  P0  =  .075  curves 
in  Figures  5  and  6  of  that  reference.  As  is  clearly  seen  in  Figures  2  and  3,  the  convergence 
rate  of  both  lattice  algorithms  is  highly  insensitive  to  the  channel  eigenvalue  disparity. 
However,  the  LSALE  algorithm  converges  in  approximately  40  iterations  for  both  channels. 
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Figure  2.  Comparison  by  simulation  of  convergence  properties  for  eigenvalue 
ratio  =11. 


Figure  3.  Comparison  by  simulation  of  convergence  properties  for  eigenvalue 
ratio  =  21. 


whereas  ALCE  required  approximately  1 20  iterations  to  converge.  The  improved 
convergence  performance  of  both  lattice  algorithms  over  the  TDL  gradient  algorithm  is 
clearly  observed. 

SECTIONS.  CONCLUSIONS 

In  this  report  we  have  shown  how  the  new  least  squares,  lattice  algorithms  may  be 
applied  to  data  equalization.  In  particular,  a  new  least  squares  adaptive  lattice  equalizer 
(LSALE)  algorithm  was  presented  and  the  improved  initial  convergence  performance  of 
LSALE  over  gradient  based  algorithms  (implemented  in  either  TDL  or  lattice  structure)  was 
clearly  observed  in  Section  4.  Additional  properties  of  least  squares  lattice  algorithms  are 
examined  in  References  12  and  13. 


APPENDIX:  DERIVATION  OF  THE  LEAST  SQUARES  ADAPTIVE 
LATTICE  EQUALIZER  ALGORITHM 

In  deriving  the  least  squares  lattice  algorithm,  considerable  use  is  made  of  the 
following  properties  of  the  <Rm(n)  matrix,  which  may  easily  be  derived  from  its  definition, 
Equation  3 : 


<Vn>  = 


I 

— 

1 

Qm(n)| 

flm-l  (n-1) 

flm-l<n> 

• 

|Vm(n> 

vLn) 

m 

|vm<n>  _ 

(Ala) 


(Alb) 


The  dashed  lines  in  Equations  Ala  and  Alb  are  used  to  denote  partitioning.  The  quantities 
qm(n)  and  vm(n)  denote  scalars  which  are  given  by: 


and 


qm(n) =  ^  wn_p  x2(P)  - 

p=0 


vm(n)=  ^  wn~P  x2(p-m)  . 

p=0 


(A2a) 


(A2b) 


Also,  Qm(n)  and  Vm(n)  in  Equations  A 1  a  and  Alb  denote  m-dimensional  vectors  given  by: 


Qm(n)  =  ^  w"  P  x(p)  Xm-l(p-1)  ’ 

p=0 


(A2c) 


and 


Vm(n)=  ^  wn-p  x(p-m)  Xm_j(p)  . 

p=0 

A  third  property  of  the  <Rm(n)  matrix  is  the  following  time  shift  relation: 


(A2d) 


«m(n)  =  w  <Rm(n-l )  +  Xm(n)  X^  (n) . 


'm 


m''“/  '*m 


(A3) 
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fVTAW*';.  *  ■ 


As  in  the  case  of  the  fast  Kalman  algorithm,  ^  ®  the  least  squares  lattice  equalizer  is 
intimately  related  to  the  one-step,  backward  and  forward  least  squares  predictor.  Therefore, 
the  following  sums  of  squared  errors  are  introduced: 

n 

y  ^  em(P>n)  » 


it 

y  Wn~p  r^(p,n), 
p=0 


where 


em(P.n) =  x(p)  +  A^  (n)  Xm_1(p-1)  , 


rm(p,n)  =  x(p-m)  +  B  J(n)  X^jfp). 


(A4a) 


(A4b) 


The  quantities  e^fp^)  and  rm(p,n)  are  called  the  m^  order  forward  and  backward  pre¬ 
diction  error  residuals,  respectively,  and  the  m-dimensional  vectors  A^n)  and  Bm(n)  in 
Equation  A4  are  chosen  to  minimize  the  above  exponentially  weighted  sums  of  squared 
errors.  Differentiating  these  sums  with  respect  to  the  coefficients  of  the  Am(n)  and  Bm(n) 
vectors  and  setting  the  results  equal  to  zero  leads  to  the  following  augmented  matrix 
equations: 


flm<n>^m(n>  = 


(A5a) 


<Rm(n)  Bm(n)  = 


(A5b) 


e,L(n) 

m 


In  Equation  A5  0m  denotes  the  m-dimensional  zero  vector.  Also,  Am(n)  and  Bm(n)  are 
the  following  extended  (m+1 )  -  dimensional  vectors: 


*m<n>  = 


(A6a) 


Am(n) 


and 


(A6b) 


Finally,  in  Equation  A5,  e^(n)  and  e^(n)  are  the  minimum  of  the  above  exponentially 
weighted  sums  of  squared  errors: 


e£(n)  =  min 


n 

wn-p  e^(p,n) 

p=0 


n 

=  ^  wn-p  x2(p)  +  A^(n)  Qm(n)  , 

p=0 


and 


ei,(n)  =  min 
mv  ’ 


X  wI1~P  rm(p,n) 

p=0 


(A7a) 


n 

=  ^  wn-P  x2(p-m)  +  B^(n)  Vm(n)  .  (A7b) 

p=0 

As  will  be  seen,  the  vectors  Am(n)  and  Bm(n)  play  a  central  role  in  the  development 
of  the  least  squares,  lattice  algorithm. 

Another  auxiliary  vector  which  is  crucial  to  the  development  of  this  algorithm  is  the 
(m+1)  -  dimensional  vector,  Cm(n),  which  is  given  by  the  solution  to: 

fim(n)  Cm(n)  =  xm(n>  •  (A8) 


At  this  point  we  will  concentrate  on  obtaining  order  updates  for  the  three  vectors,  Am(n), 


Am+l(n)  = 


ah  pat  11  v 

W1(U  , 

- 

Am(n) 

km<n> 

0 

0 

em  (n-D 

Bm(n-1) 

L.  J 

(A9) 


where 


(A10) 
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Equation  A9  may  be  verified  by  premultiplying  its  right  hand  side  by  (n)  and  noting 
with  the  aid  of  Equations  A1  and  A5  that  the  last  m+1  elements  of  the  resulting  column 
vector  vanish.  This  implies  that  the  last  m+1  elements  of  the  column  vector  defined  by  the 
right  hand  side  of  Equation  A9  satisfy  the  same  equation  that  is  satisfied  by  the  m+1 
elements  of  Am+j(n)  (obtained  from  Equation  A5a  with  m  replaced  by  m+1).  Therefore, 
assuming  that  the  matrices,  (Rm(n),  are  nonsingular*  the  last  m+1  elements  of  the  column 
vector  defined  by  the  right  hand  side  of  Equation  A9  must  equal  the  m+1  elements  of 
Am+i(n)-  Also,  the  first  element  of  the  column  vector  defined  by  the  right  hand  side  of 
Equation  A9  equals  unity.  Thus,  Equation  9  is  verified. 

An  order  recursion  for  e^(n)  also  can  be  derived  by  premultiplying  the  right  hand 
side  of  Equation  A9  by  <Rm+j(n)  and  noting  that  the  first  element  of  the  resulting  column 
vector  must  equal  e^+j(n).  The  resulting  recursion  for  e^(n)  is  given  by 


em+l(n>  =  €m<n>  ‘ 


km(n)^m(n) 

el(n-l) 

m 


(All) 


where 

tm(n)  =  q£+  ,  (n)  Bm(n- 1 )  .  (A  1 2) 

a 

In  the  order  recursion  for  £^1+1^’ two  sca^ars>  km(n)  and  km(n),  appear.  These  can  be 
shown  to  be  equal  by  considering  the  product 

0  =  (0,  B^(n-l) )  <Rm+1(n)(A^(n),0)T.  (A13) 

From  Equations  Alb,  A5a  and  A10 

0  =  (0,  B^(n-l) )  (e  « (n),  0*,  km(n)  )T  =  km(n).  (A  14a) 

On  the  other  hand,  using  Equations  Ala,  A5b  and  A1 2,  we  have: 

0  =  (£m(n),  0j,  e^(n-l ) )  (A^Oi),  0)T  =tm(n) .  (A14b) 

Comparing  Equations  A14a  and  A14b  shows  that  km(n)  =1cm(n).  Therefore,  Equation  A1 1 
may  be  rewritten  as 


£m+l(n>  =  em(n>- 


km<n> 

£>-') 


(A15) 


In  a  manner  analogous  to  the  development  of  Equations  A9  and  A1S,  we  also  can 
derive  the  following  order  update  recursions  for  Bm(n)  and  e^fn): 


•In  practice,  the  positive  definiteness  (and  hence  nonsingularity)  of  ^(n)  can  be  guaranteed  by 
initializing  ^(n)  to  a  positive  scalar  times  the  identity  matrix. 
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Bm+l<n>  = 


0 


(A  16) 


and 


»  “ 

0 

km(n) 

Am(n) 

em(n> 

0 

M  - 

4+i(n)*  *£<"-*>  - 


k2(n) 

m 

e®(n) 

m 


(A  17) 


To  complete  the  development  of  the  order  updates,  Cm(n)  obeys  the  order  recursion: 
Cm-l<n> 

I  rm(.n,n;  _ 

(A  18) 


Cm(n)  - 


rm(n,n) 

+  — — V")  • 


eJL(n) 

m 


Equation  A18  may  be  verified  by  premultiplying  its  right  hand  side  by  <Rm(n)  and  noting 
that  from  Equations  Alb  and  A8: 


<Rm(n)  (cT_1(n),0)T  =  (xT_1<n),a)T> 


(A  19) 


where  the  constant  a  is  given  by  (from  Equations  Alb  and  A8) 

»  =  =  •  <A20> 

However,  from  Equations  Alb,  A4b  and  A5b 

a  =  x(n-m)  -  rm(n,n)  .  (A2 1 ) 

Using  Equation  A5b  as  well  as  A19  and  A21,  it  is  seen  that  the  product  of  <Rm(n)  with  the 
right  hand  side  of  Equation  A18  is  simply  the  vector,  Xm(n).  Thus,  the  right  hand  side  of 
A18  satisfies  the  equation  for  Cm(n),  A8.  This  verifies  Equation  A18. 

Aside  from  the  order  update  recursions  derived  above,  we  also  will  need  certain  time 
update  recursions.  In  particular, 

em(n,n) 

Am(n)  =  Am(n-l)-  - -  ■  - 


where  the  scalar  7m(n)  is  given  by: 

7m(n) =  xm(n)  cm*n> =  Xm(n)  «m(n>  Xm(n>  *  (A23) 

As  can  be  seen  from  Equation  23  (see  References  5  and  1 1),  Tm(n)  is  bounded  between  0  and 
1.  Equation  A22  may  be  derived  by  noting  from  Equate  3  Ala  and  A5a  that 

Am(n-1 )  =  -  «m-l<n-2)  Qm^"1  )■  (A24a) 


Cm-jOt-D 


(A22) 
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Also,  from  Equation  A3 

Qm(n)  =  wQm(n-l)  +  x(n)Xm_j(n-l)  .  (A24b) 

Finally,  using  a  well  known  matrix  inversion  lemma,  we  may  relate  flJj|_j(n-2)  to  ft^_j(n-l ) 
as  follows.: 
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Lattice  recursions  can  now  be  derived  for  em(n)  and  rm(n-l)  by  postmultiplying 
both  sides  of  Equations  A9  and  A16  (with  n  replaced  by  n-1)  by  X^+j(n).  The  resulting 
recursions  are  given  by: 


em+l(n>  =  em<n>  ' 


km(n-l ) 

e>-2) 


rm(n-l)  , 


(A3  la) 


4(n-D 


em(n)  ' 


(A3  lb) 


Likewise,  an  order  recursion  for  7m(n)  may  be  obtained  by  premultiplying  both  sides  of 
Equation  A18  by  X^(n)  and  using  A28b.  The  result  is 


ymw=ym-iw+ 


rm(n)(l  -Tm_}(n) ) 

eL.(n) 

m 


(A3  2) 


Equations  A  IS,  A17,  A29,  A31  and  A3  2  represent  the  least  squares  adaptive  lattice 
algorithm  which  generates  the  residuals  em(n)  and  rm(n).  To  complete  the  development  of 
the  least  squares  lattice  equalizer  algorithm,  we  return  to  the  problem  of  obtaining  the 
least  squares  coefficient  vector  Fm(n)  defined  by  Equation  2,  with  N  replaced  by  m.  First, 
note  that  Equation  2  may  be  rewritten  in  the  following  form: 


«m<n)Fm<n>  +  Qm<n)  =  0m+l 


(A33) 


where 


u 

Qm(n) =  ^  wn_P  a(p)  Xm(p)  ’ 

p=0 


(A34) 


and  0  <  m  <  N.  It  should  be  pointed  out  that  in  replacing  N  in  Equation  2  by  m  in  Equation 
A33,  we  are  actually  considering  the  larger  problem  of  generating  all  the  least  squares  coef¬ 
ficient  vectors,  Fm(n),  m=0,l, . . .  ,N.  As  will  be  seen,  in  the  lattice  formulation  of  the  least 
squares  problem,  all  of  these  vectors  are  generated  automatically. 

In  analogy  with  Equation  A5a  for  the  forward  prediction  vector  Am(n),  we  also  have 
the  following  augmented  matrix  equation  for  Fm(n) 


Pm<n> 


*Wn>Fm(n)  = 


where  <?m(n)  is  an  (m+2)  x(m+2)  dimensional  matrix  given  by: 


(A35) 
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(A36) 


n 

»n'PXm(P)X,I(P)  , 

p=0 

and  Xm(p)  is  an  (m+2)  -  dimensional  column  vector  given  by  : 

Xm(p)  =  (a(p),  x(p),  x(p-l ), . . . ,  x(p-m)  )T.  (A37) 


Also,  in  Equation  A35,  the  (m+2)  -  dimensional  extended  vector,  Fm(n)  is  given  by: 


1 


Fm(n) 


[Fm(n)J 

and  pm(n)  is  the  minimum  of  the  sum  of  exponentially  weighted  least  squares  error 
residuals,  i.e., 


(A38) 


pm(n)  =  min 


]>  wn"P  (em(p,n)  )2 

p=0 


where 


=  £  wn‘P  a2(p)  +  F*(n)  Qm(n) , 

p=0 


(A39) 


em(p,n)  =  a(p)  +  F^(n)  Xm(p). 

In  analogy  with  Equations  Al,  A2  and  A3,  it  easily  can  be  seen  from  A36  that 


flm(n)  possesses 

the  following  properties: 

sm<n>  = 

Jlmfr  >  1 _ 

1 

Qn»| 

«m-l<n) 

Vm<"> 

— T  ^ 

—  — 

Vm<"> 

w 

vm(n)  _ 

(A40) 


(A41a) 


(A41b) 


and 

«m(n)  =  w  flnjCn-lJ  +  XnjfnJX^Cn)  . 


(A41c) 
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In  Equations  A41a  and  A41b, 


11 

qm(n)  =  ^  wn_P  a2(p)  , 

p=0 


(A42a) 


Vm(n)=  ^  wn'Px(p-m)Xm_|(p)  , 


(A42b) 


ll 

vm(n)  =  wn-P  x2(p-m)  =  vm(n)  - 

p=0 


(A42c) 


The  last  equality  in  Equation  A42c  follows  directly  from  the  definition  of  vm(n), 
Equation  A2b. 

Using  Equations  A41 ,  we  may  now  derive  order  update  recursions  for  Fm(n).  The 
key  relation  which  links  Fm(n)  with  the  least  squares  backward  prediction  residuals  is  the 
following  recursion: 


Fm+1  ^ 


Fm(n) 


km+l<n> 

em+l^  ®m+l^n^ 


(A43) 


where  the  scalar,  km+j(n),  is  given  by: 

W">  =  vj;+i<n)Fm<n).  (A44) 

The  derivation  of  Equations  A43  and  A44  is  analogous  to  the  derivation  of  A9  and  follows 
by  pre multiplying  the  right  hand  side  of  A43  by  fim+](n)  and_then  using  Equations  A5b, 

A35  and  A41.  Also,  we  can  obtain  a  time  update  relation  for  Fm(n).  In  particular,  we  have: 


Fm(n)  =  Fm(n-D  * 


em(n,n) 

1  ~  Tm(n) 


Cm(n) 


(A45) 


The  derivation  of  Equation  A45  is  analogous  to  the  derivation  of  Equation  A22  (with 
<R^j_l(n-2)  replaced  by  <?j^(n-l)  and  Qm(n-1)  replaced  by  Qm(n-l)  in  Equation  A24a  and 
proceeding  along  a  similar  development  to  Equations  A24b  and  A25). 

We  can  now  relate  the  error  residual  em(n,n)  to  the  residual: 

■5m(n)  =  em(n,n-l)  .  (A46) 

—  T1 

Specifically,  premultiplying  both  sides  of  Equation  A45  by  X^fn)  yields: 

?m(n,n)  =  (1  -  7m(n) )  em(n)  .  (A47) 


In  analogy  with  Equation  A29,  the  following  time  update  relation  for  km(n)  may 
also  be  derived: 


lcm(n)  =  w‘Rm(n-l)  + 


em-l(n'n)rm<n»n) 

1  ->m-l(n> 


=  w  km(n-I )  +  (1  -  rm_!(n) )  em_!(n)  rm(n). 


(A48) 


The  last  equality  in  Equation  A48  follows  from  A28b  and  A47.  Equation  A48  may  be 
derived  using  A44  as  well  as  A45  and  the  time  update  relation,  which  follows  from 
Equation  A41c: 


vm+l<n)  =  w  vm+l(n-1)  +  x(n~m_1^x^(n)  •  (A49) 

Finally,  lattice  recursion  relations  forem(n)  may  be  derived  by  premultiplying  both 
sides  of  Equation  A43  (with  n  replaced  by  n-1  and  m+1  replaced  by  m)  by  X^(n).  The 
resulting  recursion  is  given  by: 

Em(n-1) 

em(n)  =  em-i(n) - rm(n>  •  (A50) 

e'(n-l) 

m 

Equations  A50,  A48,  A15,  A17,  A29,  A31  and  A32  make  up  the  complete  lattice 
equalizer  algorithm  which  is  summarized  in  Equations  6,  7  and  8.  Note  that  Equations  7g 
and  7h  are  equivalent  to  A50.  It  should  be  pointed  out  that  this  algorithm  is  a  modified 
version  of  the  least  squares  algorithm  originally  presented  in  References  4,  5,  6  and  7.  The 
modification  results  basically  from  our  use  of  the  residuals  em(n),  rm(n)  and  em(n)  as 
opposed  to  the  residuals  em(n,n),  rm(n,n)  and  em(n,n)  which  were  used  in  References  4,  5, 

6  and  7.  We  have  found  that  this  modified  version  of  the  algorithm  is  more  suitable  for 
decision-directed  equalization.  It  should  be  pointed  out  that  many  other  modified  versions 
may  be  readily  derived  using  Equations  A28  and  A47.  As  noted  in  Reference  6,  such  modi¬ 
fications  of  the  least  squares  lattice  algorithms  have  proven  useful  in  different  applications 
as  they  provide  trade-offs  between  computational  complexity  and  storage. 
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